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Abstract 

Given a graph G — (V,E), an integer fc, and a function fc : V k x V — >• {0,1}, the k th 
graph product of G w.r.t fc is the graph with vertex set V , and an edge between two vertices 
k) and y = (j/i , . . • , J/fe) iff /g(x, y) = 1. Graph products are a basic combinatorial 
object, widely studied and used in different areas such as hardness of approximation, information 
theory, etc. We study graph products for functions fc of the form /g(x, y) = 1 iff there are at 
least t indices i 6 [fc] s.t. (xi,yi) <E E, where t € [fc] is a fixed parameter in fc- This framework 
generalizes the well-known graph tensor-product (obtained for t = k) and the graph or-product 
(obtained for t = 1). The property that interests us is the edge distribution in such graphs. We 
show that if G has a spectral gap, then the number of edges connecting "large-enough" sets in 
G k is "well-behaved", namely, it is close to the expected value, had the sets been random. We 
extend our results to bi-partite graph products as well. For a bi-partite graph G = (X, Y, E) , the 
k th bi-partite graph product of G w.r.t fc is the bi-partite graph with vertex sets X k and Y k and 
edges between x e X k and y e Y k iff /g(x, y) = 1. Finally, for both types of graph products, 
optimality is asserted using the "Converse to the Expander Mixing Lemma" obtained by Bilu and 
Linial in 2006. A byproduct of our proof technique is a new explicit construction of a family of 
co-spectral graphs. 
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1 Introduction 



Let G = (V, E) be a given undirected graph and let k be an integer. For a function Jq : V k x V k —> 
{0, 1}, the well-known graph product operation G k is the graph with vertex set V k , and an edge 
between x = [x\, . . . ,Xk) and y = (yi, . . . , y&) iff /(j(x, y) = 1. The graph product operation with 
parameter is sometimes referred to as the k th power of G. 

There are several well-known graph products that have been studied in the literature. The tensor 
product, introduced by Alfred North Whitehead and Bertrand Russell in their 1912 Principia Math- 
ematica, is defined using the function /g(x, y) = 1 iff all indices i satisfy (xj,7/j) G E. This graph 
product appears in the literature also as the weak product, or the conjunction product. It is equivalent 
to the Kronecker product of graph adjacency matrices [16]. A famous standing conjecture related to 
tensor products is Hedetniemi's conjecture from 1966 [7], which states that the chromatic number of 
the tensor product of two graphs Gi,(j2 is at most the minimum between the chromatic numbers of 
G\ and G2. 

The graph or-product (also called the co- normal/disjunctive graph product) is defined using the 
function /g(x, y) = 1 iff there exists at least one index i s.t. (xj, g/j) G E. A slightly different definition 
of the or-product was used by Garey and Johnson in their famous book [6] to prove the first hardness 
of approximation results for the graph coloring problem and the largest independent set problem 
(actually the book cover itself features a drawing of a graph product). In general, graph products are 
used as a tool in establishing hardness of approximation results, and specifically in amplifying existing 
hardness results. 

Other types of graph products were studied as well, for example the Xor graph product in which 
/c(x, y) = 1 iff an odd number of coordinates i satisfy (x«, y«) G E. This product was studied in [T3|l2"]. 
One can generalize the definitions above by taking the product of k different graphs G% , G2 , ■ ■ ■ , Gp. , 
and / : (Vi x • • • x Vk) 2 —> {0, 1}. In this paper we study the case where for every i, Gi = G, and we 
note that under suitable conditions on the GVs, our results can be stated in the general form. 

1.1 Our Contribution and Techniques 

In this paper we study two natural generalizations of the "or" and "tensor" products. Observe that 
the only difference in the definition of the two products is in the edge-threshold parameter t in f@: at 
least one index (xi,yi) satisfying (xi,yi) G E for the or-product, and all k indices satisfying (xi,yi) G E 
for the tensor product. In this work we study graph products with an arbitrary threshold t. Formally, 
for an integer t G [k], let ff$ be the function /^(x, y) = 1 iff there exist at least t indices i s.t. 
{xi,yi) G E. Using this notation, the tensor product is obtained by taking t = k and the or-product 
by t = 1. Our notion of graph product is similar in spirit to the special graph products known as the 
non-complete extended P-sum (NEPS) graph products, introduced for the first time by Cvetkovic in 
the early 1970's and elaborated in [5]. One generalization of NEPS graph products given in |12j 
actually captures our notion of /^-graph product as a special case. More details are given in the 
technical sections. 

The second generalization that we suggest is a bi-partite graph product with threshold t. Specifi- 
cally, let G = (X, Y, E) be a bi-partite graph, and define the k th bi-partite power of G to be the graph 
with vertex sets X k U Y k and edges (x, y) iff Jq (x,y) = 1. 

In this work we consider only regular graphs G, and study the edge distribution in the k th power of 
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G. A well-known edge discrepancy result for regular graphs is the Expander Mixing Lemma pQ (EML 
for short). The EML states that for a d-regular n- vertex graph G, with second largest eigenvalue 
(in absolute value) A, and for any two sets of vertices S, T, the number of edges they span in G, 
e(S,T) = {(u,v) £ E | u £ S,v G T}, satisfies 



< \V\S\\T\- (1-1) 

The quantity d|S , ||T|/7t can be thought of as the expected number of edges spanned by random sets S 
and T. The intuitive way to read the EML is that if A < d, then the number of edges between "large 
enough" sets is well-behaved, namely it is close to the expected value. The EML as stated gives a 
trivial bound for <i-regular bi-partite graphs G (since \(G) = \ — d\ = d as well). One can rather easily 
extend and restate the EML for (f-regular bi-partite graphs (in which case A in Eq. (jl.ip refers to the 
third largest eigenvalue in absolute value, and a factor 2 multiplies d|5||T|/n): 



< \V\S\\T\. (1.2) 

Our study focuses on applying the Expander Mixing Lemma to our generalized graph products. 
The main challenge, after showing that G k is regular and computing its degree, is to obtain an upper 
bound on A. The spectrum of the tensor product, i.e. the case t = k, is well-understood, and 
has a simple clean characterization [11]. For t < k one has to work harder to compute A. The more 
challenging case is the bi-partite graph product. While previous results provide access to the spectrum 
of the non-bipartite graph product, no such result exists for the bi-partite product. The main technical 
achievement of this paper is giving an exact characterization of the spectrum of G k in the bi-partite 
setting. This is obtained by embedding G k in a certain larger graph, for which the spectrum can be 
analyzed, and then infer the spectrum of G k from that graph. Let us remark that for both types of 
graph products, optimality results can be obtained from the "converse to the EML" result obtained 

in m- 

Another way of viewing our results is using the terminology of (d, a)-jumbled graphs, coined in 
[13] . and used widely in the study of pseudo-random graphs (see the excellent survey in [10] for more 
details). A <i-regular graph G is called (d, a)-jumbled if any two sets of vertices S, T satisfy Eq. (jl.ip . 
with a replacing A. We compute the value a, s.t. G k is (d', a)-jumbled {d! is the degree of G k ). We 
do that for both types of graph products, and for every parameter t. 

Finally let us mention a byproduct of our proof technique, which may be of self interest. Recall 
that the spectrum of a graph G is the multiset of eigenvalues of its adjacency matrix. Two graphs are 
called cospectral if they have the same spectrum. Clearly isomoprhpic graphs are cospectral, but the 
interesting question is to identify pairs of graphs which are not isomorphic, yet cospectral. There are 
numerous constructions of such pairs. Seidel switching, introduced in [15], is a quite general method 
to construct such pairs, and was used in [9] for example. In this paper we give a new construction of 
co-spectral graphs. This construction is natural and simple to describe, and uses a different approach, 
which is closer in flavor to the construction in [8]. Instead of local switching, our technique can be 
viewed as a family of blow-ups of a d-regular bi-partite graph G that produce a family of co-spectral 
graphs. 

The remainder of the paper is organized as follows. In Section [2] we formally state our results. All 
the technical details and proofs follow in the subsequent sections. 
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2 Main Results 



We start with the formal definition of the graph product. For sake of precision, we replace the notation 
" G k ", which we used in the Introduction, with a more detailed and explicit notation. 

Definition 2.1. For a simple graph G = (V,E), define the graph product GP]~,t{G) to be the graph 
with vertex set V k , and an edge (x%, . . . , xj~) ~ (yi, • • • ,Vk) if there are at least t pairs (xi,yi) that 
share an edge in G. 

Definition 2.2. If G = (X,Y,E) is a simple bipartite graph, define the bi-partite graph product 

BGPk t t{G) to be the graph with vertex set {X k ,Y k ), and an edge between {x\, . . . , Xk) € X k and 
(yi, . . . , yk) £ Y k if there are at least t pairs (xi,yi) that share an edge in G. 

Let us first establish the easy fact that both graph products are regular graphs, and state their 
degrees. 

Proposition 2.3. Let G be an n-vertex d-regular graph, and G' be an n-vertex bi-partite d-regular 
graph. Then GPkj{G) is d\-regular and BGPk,t(G') is d^-regular with d\ and d<i given by: 

f=t v j f=t v 7 

The proof of Proposition 12.31 is rather straightforward and is given in Section [6l 

Before we state our main results, we introduce some notations: We let e(S, T) stand for the number 
of edges connecting two sets of vertices S and T (when the underlying graph is clear from context). 
For a graph G, we let A{G) be its adjacency matrix. Somewhat abusing notations, when we refer to 
graph eigenvalues, we mean the eigenvalues of its adjacency matrix. For a graph G with eigenvalues 
Ai > • • • > A n , let \{G) = max{A2, |A n |}. If G is bi-partite then X(G) = max{A2, |A n _i|} (the reason is 
that Ai = |A n | = d if G is bi-partite). For a D-regular iV- vertex graph, and for any two sets of vertices 
S, T, we denote by us,t the expected number of edges that connect S and T, had the sets been chosen 
uniformly at random. The following equations give this quantity for the regular and bi-partite case: 

D\S\\T\ , D\S\\T\ 2D\S\\T\ 

Our first theorem establishes a tight upper bound on the second largest eigenvalue of GPk,t{G). 

Theorem 2.4. Let GPk,t{G) be the graph product of an n-vertex d-regular graph G = (V,E) with 
A = X(G). Let A = X(GP kit (G)). If d < (n - l)/2 then 

¥-- d - d ^ A ^d- d ' 

The following result about the edge-distribution in the non-bipartite graph product is an immediate 
corollary of Theorem [220 and the EML (Eq. ([13])): 

Corollary 2.5. Under the conditions of Theorem\2.4\ for any two sets of vertices S,T in GPk t(G) 



A 



\e(S, T) - u s , T \ < - ■ d iy /\S\\T\. (2.3) 
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The next theorem is the analogue of Theorem 12.41 for the bi-partite setting. While the adjacency 
matrix of GPk,t{G) has an explicit closed expression (based on tensor products), this is not the case 
for BGPkj(G). Therefore the task of estimating A is more complicated. 

Recall that for a bi-partite graph G, X(G) is the third largest eigenvalue in absolute value. 

Theorem 2.6. Let BGPkj(G) be the bi-partite graph product of an n-vertex bi-partite d-regular graph 
G = (X,Y,E) with A = A(G). Let A be the third largest eigenvalue in absolute value of BGPk t t{G). If 
d < n/4 then 

1 A , A , 

¥ -~ d -di<A<- d -d 2 . 

Consequently, together with the EML for bi-partite graphs given in Eq. (jl.2p . we get the following 
edge-distribution result for BGPk,t(G): 

Corollary 2.7. Under the conditions of Theorem \2.6\ for any two sets of vertices S C X k and T C Y k , 

A 



\e(S, T) - M 5,x| < 2 ■ d iV\S\\T\- (2-4) 



A few remarks concerning Theorems 12.41 and 12.61 are in place. 



1. The upper bound on the discrepancy in Corollaries 12.51 and 12.71 is tight (up to log d- factors, 
and factors that depend on k). This follows from the converse to the EML result proven in 
[3J, together with our lower bound on A in Theorems 12.41 and 12.61 The converse to the EML 
reads as follow: Let H be an N- vertex D-regular graph. If for any S, T with S H T = 
\e(S,T) — [jls,t\ < a vl^l 1-^1 ' then all but the largest eigenvalue of H are bounded in absolute 
value by 0(a(l + \og{D/a))). A similar result is derived in [3] for a bi-partite regular graph, in 
which case the same upper bound is obtained on all but the two largest eigenvalues. 

2. We can restate Theorems 12.41 and 12.61 in the jumbled-graph terminology |14j . namely GPkt(G) 
is (d\, 4 • (ii)-jumbled, and BGPk,t{G) is (d 2 , 4 ■ G?2)-jumbled. 

3. If t = k, namely GPk t t{G) is the tensor product, then it is known that \{GPk t{G)) = A(f fc_1 , 
d\ = d k , or in other words \(GPkj(G)) = (4) d\. This exactly coincides with our upper bound 
on A given in Theorem 12. 4[ In fact, we obtain an exact expression for A, given in Eq. (|3.3j) . and 
for t = k, it reads exactly A = Xd k ~ 1 . 

4. The assumptions on d in the statement of both theorems is made to enable a succinct description 
for the estimates on A, and as we mentioned previously, Eq. f|3.3|) and (|4.3p spell an exact 
expression for A. 



Finally, let us discuss an application of Theorem 12.41 Let G be a d-regular expander graph, say 
d < n/2 and A < 2\[d. In this case A < n — d — 1 (a requirement in Theorem 12. 4p . Consider two sets 
of vertices S,T in GPk t(G), and for simplicity assume they have the same size \S\ = \T\ = ^n k for 
some £ G [0, 1] . For our choice of parameters, the right hand side of Eq. (|2.3p is at most 

A a f^vF\ <r 2 A I Ql 2 d il 5 H r l nk 2 

- d -^vwm< Td -di\s\ = Td --^- wri7 = d -, s ,T. 
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If, say, £ > logd/Vd, then the latter together with Eq. (|2.3p imply that 

e(5,T) = (l±e) — 



where e — > as d — > oo. In words, all "sufficiently large" sets of vertices have the "right" number of 
edges between them. 



2.1 A family of co-spectral graphs 

In Definition 12.21 we specified the bi-partite product BGPk,t{G) of a graph G = (X,Y,E) as a graph 
over the vertex set X k UY k . Namely, each vertex in BGPk t t{G) is either a fc-tuple consisting of elements 
from X, or a fc-tuple consisting of elements from Y. In our proofs to follow, we study additional forms 
of bipartite graph products for G in which vertices in the product graph are A;-tuples which may consist 
of a mixture of elements from both X and Y. 

Formally, let X and y be symbols representing the sets X and Y respectively. We define the 
concept of a template r G {X,y} k , which is a string of length k consisting of X and y symbols. 

A A;-tuple of vertices a = (a\, . . . , a&) G (X U Y) k is said to have template r = ti,...,t& iff 
a; G 1 whenever Tj = (and equivalently, G Y whenever tj =3^)- For a template r, we define its 
complement template t c by switching X to y and vice versa. For example, all vertices in BGPk t t{G) 
have either the template r = X k or its complement r c = 3^ fc - 

For a given template r, denote the fc-tuples in (X U Y) fc with template t by V T . Now, given a bi- 
partite graph G = (X UY,E), and a template r, we denote by BGPkj,T the bi-partite graph product 
with vertex set V T U VVc, in which two vertices a = (a±, . . . , a^) and b = (b\, . . . , are connected iff 
at least t pairs (aj,6j) are edges in G. In this work, we study the graphs BGPk,t,T and use them to 
prove our main results. On the way, we prove that 

Theorem 2.8. Let G = (X UY, E) be a d-regular graph. Then for every k>l and any two templates 
t,t', the graphs BGPk,t,T and BGPk,t,T' « re co-spectral. 

The proof is self contained and is given in full in Section [5j 



3 Proof of Theorem 12.4 

Let G = (V, E) be a <i-regular n- vertex graph with eigenvalues Ai > A2 > • • • > A n , and corresponding 
eigenvectors m, . . . , u n . Similarly let Ai, A2, • • • , A n fe be the eigenvalues of GPk,t(G), with correspond- 
ing eigenvectors wi, ... , w n k. In a slightly different setting and using different terminology, GP^^G) 
was studied in [12] and the following result regarding its spectrum was obtained (we rephrase that 
result to match our terminology). 

Theorem 3.1. Uty, Thm 3] Let G be an n-vertex d-regular graph with eigenvalues d = Ai > A2 > 
. . . > A n , and corresponding eigenvectors m, U2, . . . , u n . Define \\ = n — 1 — d, and A* = — 1 — \ for 
all i>2. Let B be the set of all vectors in { — 1,0, l} fe having at least t 1-entries. Then GPkj{G) has 
a spectrum consisting of eigenvalues 

k 

A^ 2 ... fc = e n (^(^) |bii + l -^(KtA , h, . . . ,h g {1, . . . ,»}. (3.1) 
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The corresponding eigenvector is w^^...^ = (8) Uj 2 • • • <g> Uj fc . 

Our proof outline is as follows: we first show that An— 1 is the largest eigenvalue of GPk t t(G), we 
then upper bound A = X(GPk t t(G)), which is the maximum over all Af^..^, 's in which not all ij are 
equal to 1. 

To prove that Au„.i is the largest eigenvalue of GP^tiG) it suffices to show that it equals d\, as 
it is well-known that the largest eigenvalue of a D-regular graph is simply D. Using Eq. (|3. 1 j) and the 
definition of Ai = d and A* = n — d — 1, we get the following expression for An...i: 

a "-i = e n (H^ 1 + H^ (n - d - i)|bjl ) • (3 - 2) 

Next we show that Eq. (|3.2p equals d\. This calculation was carried in |12j . and we present it 
here for the sake of completeness. Fix a vertex x = (x\, . . . and let us compute the number of 
vertices (y\, . . . ,yk) adjacent to x with respect to a fixed b £ B according to the following rules: if 
bj = 1 then (xj,yj) is an edge in E (in this case there are d choices for yj); if bj = then X{ = yi 
(one choice for y{)\ if bj = —1 then Xj / yi and (xj,yj) ^ E (n — d — 1 choices for j/j). This is 
reflected exactly in the product in Eq. (|3.2|) . Since every vector b specifies a different configuration of 
neighbors /non-neighbors of x, and B contains all possible configurations, we obtain An...i = d\. 

Finally we compute A. Using our last insight about An...i, the largest eigenvalue of GPk,t(G), 
we may conclude that A is the maximum over all A^^...^ in which at least one ij satisfies ij > 1. 
Intuitively, for every ij > 1, we loose a factor proportional to X^/d in the product of Eq. (|3.ip . 
Therefore, we expect A to correspond to A^^...^ where exactly one ij > 1. Let us start by computing 
the value of such eigenvalues, and then explain why indeed they give A. By symmetry it doesn't 
matter which ij > 1, so let's assume i\ > 1. 

Denote ^ Sjb = Y\f= s {^p-d^ + ^-(rt-d- l) 1 ^ 1 ) (here #b is the length of the vector b 
which, as seen below, will change throughout the proof), and let us compute Ajn...i for some i > 1. 
Using these notations and Eq. (|3.ip we obtain 

Aill-l = Y ^ 2 ,b + E * 2 > b + E (~ Ai - 2,b- 
beB,bi=l be2?,bi=0 b6B,bi=-l 

Define C r = {c £ {0, 1, — : c has at least r ones}, then the latter can be written as 

Y A ^i,c + Y ^ i - c + Y(~ Xi - = E A ^i,c - E Ai * i ' c - 

cec t _i cec t ceCt cec t -i cec t 

Simplifying further we obtain the following expression for Ajii...i: 

Aiii...i = A< Y ( 3 - 3 ) 

beB,bi=l 
b has exactly t ones 

Next we establish the upper bound on Ajii...i: 

di = An...i= Y d ^2,b+ Y (rc-d- l)* 2 ,b+ Y ^ 2 > b - E d * 2 > b 
beB,bi=l beB,bi=-l beB,bi=0 b£B,bi=l 

> Y d ^2,b = pAjii...!. 

beS,bi=l 1 
b has exactly t ones 
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In other words, Ajix—i < -£d\. As for a lower bound on Aju...i, 

Am...i= E A ^ 2 ' b = 7 E E ^> 

beB,bi=l bGB,bi=l beB,bi=l 

b has exactly t ones b has exactly t ones b has exactly t ones, and no zeros 

If we assume that d < n — d — 1, then ^i 5 b is maximized when b has the maximal number of — l's 
possible, or in other words, b has exactly t ones and no zeros. The total fraction of such vectors out 
of B is trivially at least l/3 fc . Recalling that d\ = ^beB ^l.bj we get 

Am...! > ¥ ■ - ■ d x . 

Similar arguments to the ones above apply also to the case in which more than one entry ij is 
greater than 1. For example it follows by the analysis above that Aj^n...!, for both ii,Z2 > 1, is 
smaller than A^n—i by a factor of Xj/d. This together with Eq. (j3.3|) imply that A = Aj*n...i for i* 
s.t. Xi* = X(G) (where i* is either 2 or n). 

To conclude, we obtained the following estimates on A: 

1 A , A , 

This completes the proof of the theorem. 



4 Proof of Theorem 12.61 

The proof for the bi-partite product is more complicated than the non-bipartite case. The main reason 
is that while there exists in the literature an exact characterization of the spectrum of GPkt{G), we 
do not have this for BGPk t t(G). One of the technical contributions of this paper is obtaining such a 
characterization, which also enables us to prove the bound on A in Theorem 12.61 To understand the 
spectrum of BGPkj(G) we embed it in a larger graph, whose spectrum we can analyze, and then infer 
back the spectrum of BGPk t(G). 

Next we define the graph in which we embed BGPkt(G), and state a theorem that characterizers 
its spectrum. Recall the definition of the template of an element a = (ai, . . . , a&) G (X U Y) k given 
in Section [270 the vector r G {X,y} k that satisfies Tj = X iff a, G X. We are now ready to define 
the shuffled bi-partite graph product in which we embed BGPkj(G). 

Definition 4.1. If G = (X,Y,E) is a simple bipartite graph, define the shuffled bi-partite graph 

product SGPk,t{G) to be the graph with vertex set (X U Y) k , and an edge between (oj, . . . , ak) and 
(pi, . . . ,6^) if their templates are complements of each other and there are at least t pairs that 
share an edge in G. 

In other words, the graph SGPk t t(G) is composed of the disjoint union of 2 fc - 1 graphs BGP k>t:T for 
all template pairs r, r c , amongst which is BGP^ t{G) itself. For example, let G = (X, Y, E) be defined 
with X = {x\,X2},Y = {2/1,2/2}) with only (x%,yi) G E and let k = 2, t = 1. In this case, SGPk,t{G) 
consists of the disjoint union of the two graphs BGPk t t,T and BGPkjy f° r T = <^ 2 an d t' = Xy (a 
total of 16 = \X U Y\ 2 vertices); while BGP Kt (G) = BGP k ^ T (a total' of 8 = \X\ 2 + \Y\ 2 vertices). 
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Notice that SGPk,t(G) differs from GPk t t{G) (clearly it's a subgraph of GPkj(G), yet not an induced 
one). In our example, the two vertices [x\, y%) and (2/1,2/2) are connected in GPk,t(G) but not connected 
in SGPkj(G) (as the two templates corresponding to (x±, yi) and (2/1,2/2) are not complements of each 
other). Therefore we have the inclusion relation BGPkj(G) C SGPkj(G) C GPkj(G). 

The next theorem gives an exact characterization of the spectrum of SGPk t(G). In what follows, 
for two vectors u, v 6 M n , u v stands for the standard tensor product of two vectors. 

Theorem 4.2. Let G = (X, Y, E) be a connected bi-partite n-vertex d-regular graph with eigenvalues 
d = Ai > A2 > ■ ■ ■ > A n = — d, and corresponding eigenvectors ui, 112, . . . , u n , forming an orthonormal 
basis ofM. n . Define A* = n/2 — d, A* = — n/2 + d, and A* = — Aj for every i ^ l,n. Let B be the 
set of all vectors in {—1, l} k having at least t 1-entries. Then SGPk : t{G) has a spectrum consisting of 
eigenvalues 

k 

Aw,-* = E II (Mr 1 ^ + ' h,...,i k e{l,...,n}- (4-1) 

heBj=i ^ ' 

The corresponding eigenvector is w^...^ = Uj x ® Uj 2 •••(g) Uj, . 

As we mentioned in the introduction, GPkj(G) is a special case of the graph product defined in 
|12j . Theorem 14.21 is an analogue of of Theorem 13.11 from [12] . We note that the proof of Theorem 14.21 
given in Section 14. 1} is similar in nature to the proof of Theorem 13.11 The following proposition gives 
a different view on the eigenvalues of SGPk t(G). 

Proposition 4.3. Let SGPkj(G) be the shuffled graph product of an n-vertex bi-partite d-regular graph 
G = (X, Y, E). Let Ai, . . . , A n k be the eigenvalues of SGPk,t{G). Define 

L = {i : Ai = Ai 1 i 2 ...i k s.t. every ij S {l,n}}, A = max|Aj|. (4.2) 

Then the third largest eigenvalue of BGPk,t{G) is exactly A. 

The proof of Proposition 14.31 is given at the end of this section and uses Theorem 12.81 We are now 
ready to prove Theorem 12.61 

Proof of Theorem 12. 6t Proposition 14.31 gives us the exact characterization of A. This characteri- 
zation is analogous to that of A in GPkjiG): A is the maximal among all A^^...^ in which at least 
one ij does not correspond to any of the largest eigenvalues of G (in absolute value), which are — d or 
d in the bi-partite case (i.e. ij 7^ l,n). Therefore, we can use very similar arguments to the ones in 
the proof of Theorem 12.41 to obtain exactly the same lower and upper bounds on A. For the sake of 
completeness we give the full calculation. 

Let us start by computing the value of such eigenvalues A^^...^ where i\ ^ {l,n} and i s 6 {l,n} 
for every s = 2, . . . ,k, and then explain why indeed such eigenvalues give A. By Theorem 14.21 we may 
assume w.l.o.g. that ij = 1 for all j > 2. The choice of ij = 1 or i j = n only effects the sign of A^^...^, 
which will not matter in our case since we are only interested in the absolute value. By symmetry it 
also doesn't matter which index is not 1 or n, so might as well assume it is the first. For the rest of 
the proof, we think of i\, ■ ■ ■ as fixed. 

For a vector b, let #b be its length. Denote by ^ s<h = l\f= s (^TT^ + (| - d) J . Using these 
notations and Eq. (|4.ip we obtain 

Aai-l = E A ^ 2 ' b + E - A ^2,b- 
befi,bi=l befi,bi=-l 
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Define C r = {c G {1, — l} fc 1 : c has at least r ones}, then the latter can be written as SceC _i Ai^i,c+ 
^ceCt — Aj^i jC . Simplifying further we obtain the following expression for Aai-i: 



Next we establish the upper bound on Ajn...i: 



beB,bi=l 

b has exactly t ones 



d 2 = A11-1 = Y d ^ 2 ' b + Y (f ~ d ) ^ 2 > b - Y d * 2 > b 

beB,bi=l beB,bi=-l beS,bi=l 

> Y d *2,b = TT A *ii-i- 

befi,bi=l 1 
b has exactly t ones 

In other words, Ajn...x < -^2- As for a lower bound on Ajn...i, 

Aai-i = Y A ^ 2 ' b = Y 

beB,b 1= i ' beB,b 1= i 

b has exactly t ones b has exactly t ones 

If we assume that d < ^ — d, then VP^b is maximized when b has the maximal number of — l's possible, 
or in other words, b has exactly t ones. The total fraction of such vectors out of B is trivially at least 
l/2 k . Recalling that di = SbeB^i.b' we 

A A < ,7 1 

Aiii...i>-j-d2-2fc. 

Similar arguments to the ones above imply for example that A.j,n...i, for both i,j g" {l,n}, is 
smaller than Ajii— i- Thus, as before, together with Eq. (|4.3p we obtain that A = Aj*ii— l for i* s.t. 
A,' = A(G). 

To conclude, we obtained the following estimates on A: 

1 A , A , 

¥ -~ d -di<A<- d -d 2 . 



This completes the proof of the theorem. 



4.1 Proof of Theorem l4~2l 

Our proof strategy, which follows the outline of the proof of Theorem 3 in |12j . is as follows: We are 
going to identify the adjacency matrix A of the graph SGP}~f(G), and then analyze its spectrum, and 

k 

show that its eigenvectors form an orthonormal basis for M n . 

We start with a few notations and definitions. Let A be the adjacency matrix of the d-regular 
bi-partite graph G = (X,Y,E), and let d = Ai, . . . , A n = — d be its eigenvalues with corresponding 
eigenvectors ui,...,u n , which we may assume form an orthonormal basis for M n . Let C be the 
following block matrix: = if i,j € X or if i,j G Y, and Cjj = 1 otherwise (in words, C is the 
adjacency matrix of the complete bi-partite graph). Define the bi-partite complement of G, denoted 
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by G, to be the bi-partite graph whose adjacency matrix is given by A = C — A. For fixed i £ [k] and 
b € B, define the auxiliary matrix: 

1 + bj „ 1 - hi 7 
M ih = + —^-A. 

In words, Mj b is either the adjacency matrix of G, if bj = 1, or of G if bj = —1. 
Using these notations, we claim that the adjacency matrix of SGPkjiG) is 

A = ^Mi b 8)M 2b 8) ■■■®M kh . (4.4) 

beB 



By the definition of matrix tensor product, every entry in A has the form 2~^ b eB rii=iC^ib)/iiPii f° r 
some h = (hi, . . . , and g = (gi, . . . , in (X U Y) k . We address that entry in A by ^4h,g> namely 

k 

4g = EII^)^- ( 4 - 5 ) 

beB i=l 

From the definition of the tensor product, it follows that the rows and column of A are indexed 
according to the following lexicographic order on X U Y: x% < yj for every x% < Xj if i < j and 
similarly j/j < yj if i < j. For example, the first row of A is indexed by the vertex (xi, . . . , xi, xi), the 
second row by (xi, . . . ,x%, X2), and so on. 

Now we can show that ^4h,g = 1 if h and g share an edge in SGP^^G), and ^4h,g = otherwise. 
Let us start with the easier case, where the templates of h and g are not complements of each other. 
We need to show that ^4h,g = as by the definition of SGPj-^iG) they cannot share an edge. Since 
the templates are not complementary, there exists an index i s.t. both hi and gi belong to, say, X. 
Therefore, no matter what b£Bwe choose, (M i \ =l )f li g i = 0, since (hi,gi) is not an edge of G nor of 
G. Therefore the product in Eq. ()4.5h is always zero. Next assume that h and g have complementary 
templates. Let b be the vector whose entries are bj = 1 if (hi,gi) S E(G) and bj = —1 otherwise. 
If indeed h and g share an edge in SGPk,t(G), then for this specific b, the value (Mjb)h l5l is 1 for 
every i € [k], since by definition the vector b "selects" the correct matrix A or A. For all other b's, 
some (Mjb)fc. Si is going to be zero, as for some index i the "wrong" adjacency matrix is going to be 
chosen. All in all, if h and g share an edge in SGPk t t(G), then A^g = 1. Conversely, if h and g 
don't share an edge in SGPk t t{G), then for every b 6 £>, there must be some index i s.t. bj = 1 but 
(hi,g%) 4- E (otherwise, there are at least t pairs (hi,gt) that share an edge in G, and by the definition 
of SGPkj(G) we should have placed an edge between h and g). In this case A^ gi = and also by 
definition M ib = A. Thus, the product in Eq. f|4.5j) is zeroed. 

Next let us show that Wj = Wj 1 j 2 ...j fc = Uj x (g> Uj 2 • • • (g> Uj fc is an eigenvector of A, with eigenvalue 
Aj = Ai 1 .„i k , as defined in Eq. (I4.1|) . To that end, we first show that the eigenvalues of A are exactly 
A|, A2, • • • , A* as defined in Theorem 14.21 with eigenvectors ui, . . . , u ra . This follows immediately from 
the definition of A = C — A, and the simple observation that Cuj = for every i / l,n (since 
Uj _L ui,u n , it is also perpendicular to every row of C which is simply 0.5(ui + u n ) or 0.5(ui — u n )). 
To see why Aj is an eigenvector of A, use the following fact about tensor products: for two matrices 
P, Q and two vectors u, v: (P <g> Q)(u ® v) = (P u ) (Qv). 
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4.2 Proof of Proposition 14.31 



Let G = (X, Y, E) be a connected bi-partite (i-regular n- vertex graph, and let SGPk : t(G) be its shuffled 
bi-partite graph product with vertex set V = (X U Y) k . Set N = 2{n/2) k and M = n k . Recall that 
the different BGPk^ }T (G)'s are cospectral (Theorem 12 .8p . and let us denote by ^2, ■ ■ ■ their 
set of eigenvalues with corresponding eigenvectors vj", . . . ,vjy. Similarly, let Ai, A2, • • • , Am, be the 
eigenvalues of SGPk,t(G). 

The first observation that we make is that the spectrum of SGPkj(G) consists of the eigenvalues 
V^i, . . . , ^at, each with multiplicity 2 fc /2. This clearly accounts for the entire spectrum of SGP^ t(G) 
since N • 2 fe /2 = M. To see this, for every template pair r,r c , embed the vector vj in R A/ by 
padding with zeros for all entries that do not correspond to r, r c . The padded vector is an eigenvector 
of SGPkj{G) with eigenvalue In this way we obtain 2 k /2 linearly independent eigenvectors of 
SGPk,t(G) for every eigenvalue VtV 

The next step is to figure out the eigenvalues Aj that correspond to the set I defined in Eq. ( 14.2ft . We 
shall use Theorem 14. 21 to carry out this task. Let Ai, . . . , A n be the eigenvalues of G with corresponding 
eigenvectors ui, . . . ,u n . Since G is bi-partite we have u n = (l n /2, — ln/2)) as wen as u i = ^n- Recall 
the definition of Aj given in Eq. (|4.ip . 

A, = a,,.,, = e n + • ( 4 - 6 ) 

beBj=i v y 

By the definition of the set I, every ij is either 1 or n. Fix b 6 B with exactly t ones. Let p denote 
the total number of indices j s.t. ij = n in Aj, and let r stand for the number of j's s.t. ij = n and 
bj = 1. Substituting Aj 3 and A*, according to their definition in Theorem 14.21 the product in Eq. (14. 6ft 
equals exactly 

it-r, ,vr / n \P- r fn \k-t-(p-r) lN „ rf /n A fc ~* 

Summing over all vectors b G B we get 

A, = W±*{\ («> 

t'=t ^ ' 

Recalling the value of the degree cfo of BGPk,t(G) in Eq. (|2.ip . we get that Eq. (|4.7p is exactly (— l) p d2. 
The set J is of size 2 k , and exactly half of the choices i\ ■ ■ - ik have an odd number of j's s.t. ij = n. 
Therefore the set {Aj : i G 1} contains c?2 2 fc /2 times, and — ^2 2 k /2 times. Since BGPk^,r{G) is 
bi-partite, we have \&i = di and = — c?2- The latter, together with the previous observation imply 
that the set {Aj : i ^ 1} = {^2, ^3, ■ ■ , *iv-i}- In turn, A = maxj^/ |Aj| = max{f2, ^at-i}, which is 
the third largest eigenvalue of BGPk,t{G) in absolute value. This completes the proof of Proposition 
Ol 

5 Proof of Theorem 

Before we approach the actual proof we need a few preliminary results and definitions. The following 
well known lemma gives a necessary and sufficient condition for two graphs to be cospectral (see for 
example [8], Lemma 2.1). 
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Lemma 5.1. Let G\ and G2 be two n-vertex graphs, with adjacency matrices A\ and A2 respectively. 
The two graphs G\ and G2 are cospectral ifftr(A^) = tr^A^j f°r every £ > 1. 

Let us state the lemma in words. Recall that the i th diagonal entry of the I th power of the 
adjacency matrix of a graph is the number of closed paths that contain vertex i in the graph. Hence 
the trace of the £ th power is the sum of closed paths of length I with over counting. In words, 
Lemma 15.11 states that two graphs are co-spectral, if these quantities are the same in both for every 
I. We shall prove a somewhat stronger claim, that in particular implies the latter. For an ordered 
set p = (ai,<22, . . . ,a£,a£ + i) of vertices in (X U Y) k , define its connectivity vector c(p) according to 
the following rule: for every index i s.t. cfj = (m, . . . , life) and aj + i = {v\, . . . ,Vk) that share exactly 
q edges (u s ,v s ) E E{G), we set c, = q. In particular, p is a cycle in BGPk : t,T iff c i(p) — t for every 
i. We say that an ordered set (a\,a2, ■ ■ ■ ,ag,ci£ + i) is circular and alternating if a^ + i = ai, and every 
two adjacent vertices in the set belong to complementary templates. 

We shall prove the following proposition regarding the set of connectivity vectors that belong to 
different templates. As a simple corollary we get the cospectrality result. For simplicity, we treat 
all sets of vertices as ordered sets. This incurs over counting, which will not matter, as it cancels 
out. Also observe that two different sets of vertices may have the same connectivity vector. We treat 
the two vectors as different vectors. In other words, the sets C T defined below should be treated as 
multi-sets. 

Proposition 5.2. Fix I, and let C T be the multi-set of connectivity vectors of all circular and alter- 
nating t-vertex sets in BGPk t t,r, and similarly define C T > . Then C T > = C T for any pair of templates 
t, t' and any £ > 0. 



Before proving the proposition, we establish the following auxiliary result concerning bi-partite d- 
regular graphs G = (XUY,E). We say that an ordered set (v\,V2, ■ ■ ■ ,V£,v\) obeys a vector u € {0, 1}^ 
if (vi,Vi + i) is an edge of G iff Uj = 1 (for i = t we consider the edge between V£ and vi). Let \I/ U> x be 
the set of all alternating closed paths in G that obey u and v% G X. Similarly define ^u.y- 

Lemma 5.3. Let G = (X U Y, E) be a d-regular n-vertex bi-partite graph. For every £ > and every 
vector u 6 {0, 1} , we have |^ u ,y| = l^u.xl- 

Proof. If £ is odd, then clearly |\P U y| = |^ux| = 0) since G is bi-partite. Now consider an even £. Let 
C be the adjacency matrix of the complete bi-partite n-vertex graph, and A be the adjacency matrix 
of G. Recall our dentition of the bi-partite complement of G, denoted by G, which is the bi-partite 
graph whose adjacency matrix is given by A = C — A. Let I\ be the n x n matrix, whose first n/2 
diagonal entries are 1, and all other entries are 0. Similarly define I2 w.r.t. to the last n/2 diagonal 
entries. Using these definitions we claim that 

|*u,x| = tr (^h ■ J] + (1 - Ui)A) j , |* Uj y| = tr (l 2 ■ J] (u,A + (1 - u^A^j . (5.1) 

The j th diagonal entry in the matrix product Y\l=i ( u i^ + (1 — Uj)A) is the total number of closed 
paths that start at Xj (if j < n/2, or yj- n /2 if 3 > n /2) and obey u. If u = l e for example, then we 
get the standard interpretation of taking powers of the adjacency matrix. Multiplying by I\ (or I2) 
simply extracts the relevant paths: starting at X or Y (the trace of a matrix product obeys the rule 
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The product Y\\=i { u iA + (1 — Uj)yi) defines a polynomial in A (replace A by C — A). When taking 
the actual products, we get two types of terms: we get A , or terms of the form (— \yz+ s ±+~A sl C S2 A S3 ■ ■ 
for some natural numbers Sj. As A and C commute, one can readily verify that the second type of 
terms simplify to b • (J — C), where J is the all-one matrix, and b = cp 1+S3+ --- (H) +«2+s4+...^ ug 
denote this polynomial by P = A +T, where T is the sum of all type-two terms. Using the linearity of 
the trace operator, Eq. (|5.ip can be rewritten as tr • nf=i ( u i^4 + (1 — Ui)A)^j = tr(IiA e )+tr(IiT). 

By our characterization of T, it holds that tr{I\T) = tr(I 2 T). As for tr(IiA ), this is the sum over all 
i of the number of closed paths of length t that start at Xj. The same is true for tr(I 2 A e ) just with y^. 
However there is a natural bijection between the two sets: map x\ x — y^ — X{ 2 — ... to y^ — X{ 2 — .... 
To conclude, we got 



|*u,x| = tr ■ ]J ( Ui A + (1 - Ui )A) j = 

= tr(hT) + tr(hA e ) = tr(I 2 T) + tr(I 2 A e ) = tr ( I 2 ■ ]J ( Ui A + (1 - Ui)A) \ = \V UjY \ 



i=i 



We are now ready to prove Proposition 15.21 

Proof. (Proposition 15. 2p We fix the parameter t and prove via induction on k. The base case, k = 1, 
is true in a vacuous way since for k = 1 there is only one template pair. Assume the claim is true 
up to k — 1 and let us prove it for k. Fix a template r of length k, and let r be its (k — l)-prefix. 
The graph BGPk : t )T is obtained from BGPk-i,t,T by extending each (k — l)-tuple with a vertex from 
X UY (according to r) and updating the edge set accordingly (existing edges remain, but new edges 
may appear). 

Let c € ^ be a connectivity vector corresponding to the (circular and alternating) ordered 
set a = (ai,a 2 ■ ■ ■ ,a£,a^ + i) with each in BGPk-ij,T- Let u G {0, 1}^. An update of a by u is an 
extended version sl^ of a in which one appends to each <n £ (XL)Y) k ~ 1 a vertex v % inXUF (according 
to the template r) such that v = (vi,v 2 , . . . ,V(,vg + i) in an alternating closed path that obeys u, i.e., 
v is either in 

t X or ^ u ,y- For any such extension of a( fc ) = (a^ , . . . , , «S) (which is circular 

and alternating and consists of /c-tuples a\ £ (IU Y) k of BGPkj^), the corresponding connectivity 
vector is exactly c + u. The set C T consists of the multi-set of connectivity vectors obtained by this 
process starting from any a and any u as above. 

(k—l) 

To prove the induction step, it suffices to show that for any connectivity vector c G 
corresponding to a circular and alternating a = (ai, a 2 . . . , ag, ai+i) in BGPk-ij,r and any vector 
u G {0, 1}^, the number extensions a.^ of a by u does not depend on a, r or r. 

The latter follows from the fact that the number of alternating closed paths v = (v\, v 2 , ■ ■ ■ , vg, vn + \) 
that obey u is determined completely by G = (X, Y, E) and is independent of a and t. However, the 
value at hand may potentially depend on r only through the question whether v\ G X or v\ G Y. For 
v\ G X the number of alternating closed paths v is the size of *f> u ,x and for v\ G Y, the size of ^ U ,Y- 
By Lemma 15.31 these two are equal and we may conclude our proof. ■ 
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6 Proof of Proposition 



2.3 



Fix a vertex x = [x\, . . . , x^), and let us compute the number of neighbors (y\, . . . , y^) that x has in 
GPk,t{G). Fix some t' > t, there are Q,) ways to choose the indices j for which (xj,yj) £ E(G). For 
every such j, there are d possible ?/j's. For the other Xj's, there are n — d non-neighbors to choose 
from (this includes Xj itself, as the graph G is simple). Now sum over all possible t' > t to obtain 

di = H%t\n-df-t'. 
t'=t ^ ' 

Since x was arbitrary, this equality holds for every x, hence GPkt(G) is (fi-regular. Similar 
arguments give the bi-partite case, and the shuffled product, which is composed of 2 fc_1 disjoint bi- 
partite graphs, similar to BGPk,t(G). 
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